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METHOD AND APPARATUS FOR CONDUCTING LINKED SIMULATION 
OPERATIONS UTILIZING A COMPUTER-BASED SYSTEM MODEL 

[0001] The present application is a continuation of PCT patent application no. 
PCT/US00/10373 entitled "METHOD AND APPARATUS FOR PERFORMING A 
LINKED EXPERIMENT SEQUENCE", filed April 14, 2000, which claims priority from 
U.S. provisional patent application no. 60/129,680 entitled "METHOD AND 
APPARATUS FOR PERFORMING A LINKED EXPERIMENT SEQUENCE", filed April 
16, 1999. 

FIELD OF THE INVENTION 

[0002] The present invention relates generally to the field of computer-based 
simulations and, more specifically, to the linking of a sequence of simulations 
operations performed utilizing a computer-based system model. 

BACKGROUND OF THE INVENTION 

r0003l Simulation and modeling software typically allows a model operator to 
perform simulation operations over a specified time interval, each simulation operation 
utilizing specified inputs (e.g., rate constants and initial conditions) to generate specific 
outputs over the time interval for the operation. However, prior art simulation models, 
and interfaces for specifying simulations operations performed by such simulation 
models, do not provide a convenient mechanism for specifying a sequence of 
simulation operations whereby each operation in that sequence may employ varying 
inputs (e.g., rate constants) or a resetting of the state (initial conditions) of the modeled 
system. 

SUMMARY OF THE INVENTION 

[0004] According to the invention, there is provided a method of conducting a 
sequence of linked simulation operations utilizing a computer-based model. A first 
simulation operation is performed utilizing the model to generate an output condition 
for the model. A plurality of further simulation operations are performed utilizing the 
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model. Each such further simulation operation at least partially and automatically 
inherits the output condition, generated by the first simulation operation, as an input 
condition. 

[0005] In one embodiment, at least one of the plurality of further simulation 
operations automatically utilizes a delta condition, in conjunction with a subset of the 
output condition of the first simulation operation, as the input condition. 

[0006] Other features of the present invention will be apparent from the 
accompanying drawings and from the detailed description that follows. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0007] The present invention is illustrated by way of example and not limitation in 
the figures of the accompanying drawings, in which like references indicate similar 
elements and in which: 

[0008] Figure 1 is a block diagram illustrating an exemplary computer-based system 
model that executes on a computer system to perform simulation operations. 

[0009] Figure 2 is an inheritance diagram illustrating structure of an exemplary 
experiment class. 

[0010] Figure 3 is a diagrammatic representation of the performance of an 
exemplary simulation operation, in the form of an experiment, over a predetermined 
time period. 

[0011] Figure 4 is a block diagram plotting a value for a time-variant parameter of 
the system model shown in Figure 1. 

[0012] Figure 5 is a flowchart illustrating a method, according to an exemplary 
embodiment of the present invention, of conducting sequential simulation operations 
utilizing the system model. 



[0013] Figure 6 is a diagrammatic representation of an exemplary modification 
operation that may be performed to apply a set of delta simulation inputs to the results 
of a preceding simulation operation. 

[0014] Figure 7 is a block diagram illustrating the input and output of parameter 
values with respect to the system model 

[0015] Figure 8 shows an exemplary user interface that may be presented by an 
experiment interface of a system model. 

[0016] Figure 9 illustrates a further view of the exemplary user interface shown in 
Figure 8, where the protocol of a sequence of experiments has been partially expanded 
by user selection of an expansion button to provide further information regarding such 
experiments. 

[0017] Figure 10 illustrates an exemplary parameter set user interface. 

[0018] Figure 11 provides a diagrammatic representation of a machine in the 
exemplary form of a computer system within which a set of instructions, for causing the 
machine to perform any one of a number of methodologies, may be executed. 

DETAILED DESCRIPTION 

[0019] A method and apparatus for conducting a sequence of linked simulation 
operations utilizing a computer-based model are described. In the following 
description, for purposes of explanation, numerous specific details are set forth in order 
to provide a thorough understanding of the present invention. It will be evident, 
however, to one skilled in the art that the present invention may be practiced without 
these specific details. 

[0020] For the purposes of the present specification, the term "parameter" shall be 
taken to include, but not be limited to, a variable or an arbitrary constant that may 

appear in a mathematical expression (e.g., an equation). 
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[0021] Figure 1 is a block diagram showing an exemplary computer-based system 
model 10 that executes on a computer system 12 to perform simulation operations. The 
system model 10 may be constructed utilizing any one of number of commercially 
available modeling tools to model a wide variety of systems. Such modeling tools may 
include tools provided by Entelos, Inc. of Menlo Park, California. Other commercially 
available modeling tools include the Process Charter of Scitor Corporation of Menlo 
Park, California, PowerSim developed by Modell Data AS of Bergen, Norway, the 
ithink and Stella tools developed by High Performance Systems Incorporated of 
Hanover, New Hampshire, and the Extend + BPR developed by Imagine That! 
Incorporated of San Jose, California. 

[0022] The below description shall describe an exemplary embodiment where the 
system model 10 comprises a physiology model that simulates the physiology of 
diseases (e.g., asthma, obesity, HIV-AIDS or diabetes). Nonetheless, it will be 
appreciated that the system model 10 may model any number of systems, including but 
not limited to physiological, mechanical, environmental, chemical, biological, electrical 

or physical systems. 

[0023] A number of collections of protocols and parameters in the form of 
experiments 14, 16 and 18 are shown to provide input to the system model 10. While 
the inputs to the system model 10 are labeled "experiments", these inputs need not 
necessarily comprise experiments, but may be any collection of protocols and/ or values 
that provide input and/ or initial state to the system model 10. In the exemplary 
embodiment where the system model 10 comprises a physiology model, the 
experiments 14, 16 and 18 constitute distinct sets of conditions (e.g., environment or 
system conditions) that are imposed upon the system model 10 to determine 
performance of the system model 10 under these conditions. A first experiment 14, for 
example, includes a full set of initial values (or conditions) that define a first 
experimental condition, the second experiment 16 constitutes a subset of delta values 
and any number of further experiments 18 may constitute further subsets of delta 
values for various parameters of the system model 10. In the exemplary embodiment, 
the experiments 14, 16 and 18 are a linked, sequence of experiments that, as will be 
described in further detail below, may partially inherit an output condition (e.g., 
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parameter values) from a preceding experiment and impose delta values on other 
parameters to thereby define a new experimental condition (or configuration) that has 
some dependencies upon the output of a previous experiment. It is further envisaged 
that any of the experiments 14, 16 and 18 may utilize, or at least partially inherit, an 
output condition, or parameters, from any of the other experiments. For example, both 
experiment 16 and any number of experiments 18 may inherit an output condition from 
experiment 14. Alternatively, experiment 16 may inherit a partial output condition 
from experiment 14, and experiment 18 may inherit a partial output condition from 
experiment 16. Further details in this regard shall be provided below. 

[0024] The system model 10 is also shown to include a model interface 20 via which 
a modeler may define the system model 10 and an experiment interface 22, to be 
described in further detail below, via which a modeler may define, or modify, an 
experiment performed utilizing the system model 10. 

[0025] Figure 2 is an inheritance diagram illustrating the components of an 
exemplary experiment class 30 that may comprise any of the experiments 14, 16 and 18 
shown in Figure 1. Specifically, an experiment class 30 is shown to own one, or 
multiple, protocol classes 32, each of which may include zero, one, or multiple protocol 
items 34. Each protocol item 34 references a parameter set 36 and value set 38 pair. The 
value set 38 in the protocol item 34 is constrained to only those value sets 38 owned by 
the parameter set 36. For example, an exemplary parameter set 36 a particular 
experiment may be weight-related parameters 46 and may own a number of user- 
selectable value sets such as the "70% kg individual with 20% body fat" value set 48 and 
the "85 kg individual with 30% body fat" value set 50. 

[0026] An experiment 40, related to the experiment class 30, is accordingly shown to 
own one or more protocols 42 and a set of experiment results 44 that constitute the 
output of the system model 10, where the protocol 42 has specified a particular 
parameter set 36 having one or more value sets 38 attributed thereto. If an experiment 
30 has an initial experiment 40, then the parameter INITFROMTIME contains the time 
to get values for time-varying parameters for experiment 30 from the experiment results 
44 in experiment 40. 



[0027] Figure 3 is a diagrammatic representation of the performance of a simulation 
operation, such as for example an experiment, over a predetermined time period. At a 
first time instance (e.g., T = 0), the system model 10 is shown to be initialized with the 
experiment 14. The experiment 14 embodies a configuration 60. The configuration 60 
includes time-invariant parameter values 62 that remain unchanged over the simulation 
operation and a set of time-varying parameter initial values 64 that are modified as a 
result of the simulation operation. For example, the time-varying parameter initial 
values 64 may be integrated over the time interval of the simulation operation. 

[0028] Accordingly, after a predetermined time interval (e.g., T = N), the time- 
invariant parameter values 62, and the modified time-varying parameter values over 
time 65, are shown to constitute the experiment results 44 of the experiment 14 at the 
predetermined time (e.g., T = N). The experiment results 44 thus constitute a set of 
values for a set of model parameters that define an output condition of the experiment 
14. 

[0029] Figure 4 is a plot diagram that plots a value for a time-varying parameter of 
the system model 10 included in both experiment 14 and experiment 16 over time. The 
exemplary parameter is identified as being a patient condition parameter 70, being any 
parameter indicative of a patient's condition plotted against time 72. During 
performance of the simulation operation of experiment 14, the patient condition 
parameter 70 is shown to decline with time until a time N 74 is reached. The values for 
the various parameters of the experiment 14 (both time-invariant and time-varying) at 
time N 74 thus constitute the experiment results 44 of experiment 14. 

[0030] An experiment 16 is shown to then commence at time N 74 and at least 
partially inherits the output condition (e.g., the experiment results 44) of the experiment 
14 plus the time-invariant parameter values 62 from the experiment 14 as an input 
condition (e.g., as a configuration 60). Further, the experiment 16 may, in addition to 
the inherited values for various parameters, specify a set of delta values for a subset of 
parameters that represent a delta condition. For example, experiment 16 may, as a delta 
condition, introduce a specific drug treatment that was not present in experiment 14, so 
that the effect of this drug treatment on the patient condition parameter 70 may be 
monitored over time. A number of experiments 16, each introducing a different delta 
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condition (e.g., a different drug treatment), may at least partially utilize the output 
condition of the experiment 14 as an input condition (or configuration). 

[0031] While in one embodiment, a plot diagram, such as that shown in Figure 4, 
may be generated as a result of a sequence of linked experiments, or as results of a 
single experiment to which multiple protocols are applied, such a plot diagram may 
also be generated for discrete experiments that are not defined as being linked or 
sequenced. For example, a plot diagram such as that shown in Figure 4 may be 
generated where the experiment results for experiment 14 are manually saved, and then 
copied or at least partially introduced as a configuration 60 for experiment 16. 
Accordingly, the plot diagram shown in Figure 4 is not dependent upon a continuous, 
seamless and pre-sequenced set of experiments or protocols. According to one 
embodiment of the present invention, such a plot diagram may be generated for 
multiple simulation operations (e.g., experiments), that are manually linked. 

[0032] The plot diagram illustrated in Figure 4 is advantageous in that it allows a 
modeler, in a convenient manner, to view one or more parameters included in one or 
more experiments (or protocols) that are linked either in a predefined-manner for 
automatic linkage, or that are linked manually by a modeler who copies experimental 
results for a preceding experiment for utilization as a configuration 60 for a subsequent 
experiment. 

[0033] It should also be noted that the diagrammatic plot shown in Figure 4 may 
plot values for at least one parameter for multiple experiments (e.g., multiple 
experiments 16) that may be linked to, and received configuration conditions from, a 
preceding experiment (e.g., experiment 14). Thus, Figure 4 illustrates multiple plots for 
the patient condition 70 at B0-B4, each of the plots B0-B4 being generated as a result of a 
linked experiment 16 (or protocol). In this way, a modeler may conveniently be 
presented with a visual comparison of the effect of various experiment and protocol 
conditions on a particular experiment parameter (or parameters) for a common initial 
condition or configuration. 

[0034] The present invention contemplates linking experiment 14 and one or more 
further experiments 16, so that the further experiments 16 seamlessly and automatically 
inherit an output condition of a first experiment 14 as an input condition. In this way, 
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by linking a sequence of experiments, it is possible to create a history for a modeled 
system (e.g., a physiology system). Input conditions that constitute the output of a first 
experiment do thus not have to be restated for each of the further experiments 16, and 
outputs of the experiment 14 are automatically and seamlessly considered in linked, 
dependent experiments 16. A single experiment sequence, for example including 
experiment 14 and experiment 16, may be defined in a single experiment through the 
use of multiple protocols per experiment. Specifically, experiments 14 and 16, in one 
embodiment, need not be regarded or defined as separate or distinct experiments. In 
this case, a protocol variation may be introduced at time N 74. The multiple protocols 
may, in one example, be defined to each become active at varying times throughout the 
relevant experiment. 

[0035] It should be noted that a sequence of any number of experiments may be 
denned, with each experiment at least partially, or even completely, utilizing the output 
condition of a preceding experiment as an input condition. Furthermore, multiple 
experiments may be defined to utilize the output of a preceding experiment as an input 
condition. For example, multiple experiments 16 are shown in Figure 4 to utilize the 
output of experiment 14 as an input condition, with each of the experiments 16 
introducing a different delta condition. Each of multiple experiments 16 may also 
choose a different time than N 74, as long as the time is less than or equal to the 
duration of the preceding experiment 14. For example, experiment C is shown to utilize 
the output of experiment 14 at a different time (i.e., time M 75) as an input condition. 
This illustrates that multiple experiments may utilize a state, or conditions, of a first 
experiment at different times as input to such further experiments. 

[0036] Each of the multiple experiments 16 may, in one embodiment, be performed 
seamlessly and automatically on conclusion of the preceding experiment 14. In this 
case, a graphical plot, such as that illustrated in Figure 4, may automatically be 
displayed on a display device associated with a computer system to communicate a 
particular parameter condition to a modeler for each of the multiple experiments 16. 

[0037] Figure 5 is a flow chart illustrating a method 80, according an exemplary 
embodiment of the present invention, of conducting sequential simulation operations 
utilizing the system model 10. The method 80 commences at block 82 with the 
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definition of an initial simulation operation (e.g., the experiment 14). The definition of 
the initial simulation operation may include defining one or more parameter sets 36 for 
the experiment 14, and also selecting, inputting or defining one or more value sets 38 
for each parameter set 36. As described above, each parameter set 36 may include both 
time-invariant and time-varying parameters. 

[0038] At block 84, a first simulation operation (e.g., experiment 14) is performed 
utilizing an initial simulation input (e.g., the configuration 60) to generate a first set of 
results for the time-varying parameters over time 65 (e.g., the experiment results 44). 

[0039] At block 86, a modeler defines a delta simulation input, or inputs. Each delta 
simulation input may, for example, comprise a subset of a configuration 60 for a further 
experiment 16, while specifying the retention or inheritance of a further subset of a 
configuration 60 from the output of a preceding experiment 14 and a time N for 
retrieving the results from a preceding experiment 14. Each delta input accordingly 
may include a delta value set for a subset of values of a parameter set of a further 
experiment 16. Further details regarding how such a delta input (e.g., a further 
experiment 16) may be defined will be provided below where a discussion of an 
exemplary experiment interface 22 is provided. 

[0040] At block 88, the system model 10 applies the delta input by, for example, 
commencing a further experiment 16 upon conclusion of a preceding experiment 14. 
The application of the delta simulation input may comprise automatically or manually 
copying the time-invariant parameter values from a preceding experiment 14, then 
automatically or manually copying at time N from the experiment results 44 of a 
preceding experiment 14 , and finally utilizing the delta value set to generate the time- 
invariant parameter values 62 and time-varying parameter initial values 64 in the 
system model 10. In other words, the new values constitute a configuration 60 for a 
further experiment 16. 

[0041] Figure 6 is a diagrammatic representation of an exemplary modification 
operation that may be performed at block 88 discussed with reference to Figure 5. 
Figure 6 diagrammatically illustrates various settings of parameters in the system 
model 10, and the modification of these parameters. Each setting is shown to include 
both time-invariant parameters and time-varying parameters. A configuration 
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(experiment A) 92 comprise the configuration 60 for an initial experiment 14, and a first 
set of parameter values in the form of experiment results (experiment A) 94 comprise 
the experiment results 44 of the initial experiment 14. As illustrated, the values for the 
time-invariant parameters remain unchanged, whereas the values for the time-varying 
parameters vary over time (e.g., are integrated over time). 

[0042] A set of delta values 96 are combined with the experiment results (experiment 
A) 94 to create a second value set of parameter values in the form of a configuration 
(experiment B) 98 that constitutes the configuration for a subsequent experiment 16. 
The manner by which the experiment results (experiment A) 94 and the delta values 96 
may be combined may vary. In one embodiment, the time-invariant parameters and 
time-varying parameters are set to the experiment results (experiment A) 94. The delta 
values 96 are then applied, overwriting the corresponding values from the experiment 
results (experiment A) 94 to create the configuration (experiment B) 98. In this example, 
the configuration (experiment B) 98 thus contains both an inherited component 100 and 
a delta value component 102. It will of course be appreciated that the experiment 
results (experiment A) 94 may be modified in a number of ways by the delta values 96 
to generate the configuration (experiment B) 98. 

[0043] Returning to Figure 5, at block 90, the system model 10 performs one or more 
simulation operations (e.g., subsequent experiments 16), the further simulation 
operations being sequential to the first simulation operation performed at block 84. As 
was described above, the further simulation operations utilize the configuration 
(experiment B) 98 as a part of their configuration. 

[0044] While the operations described at blocks 82 - 90 are shown to be sequential, it 
will be appreciated that Figure 5 should not be interpreted as requiring any specific 
order to the relevant operations. For example, the defining of the delta simulation 
inputs at block 86 may be performed at any time prior to the modification of the first 
value set. 

[0045] Figure 7 is a block diagram illustrating the input and output of the various 
parameter values with respect to system model 10. Specifically, Figure 7 illustrates that 
the experiment results (experiment A) 94, outputted as a result of a first experiment 14 
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may be utilized to contribute to the configuration of any number of further 
experiments. 

[0046] Figure 8 shows an exemplary user interface 110 that may be presented by the 
experiment interface 22 of the system model 10. The user interface 110 includes a 
directory panel 112 and input panel 114. The directory panel 112 provides a directory 
listing of various simulation operations in the form of experiments that may be 
transferred to the input panel 114 by a "drag-and-drop" or any other user-selection 
operation. The exemplary experiments shown in the directory panel 112 each specify a 
distinct physiological experiment and are appropriately categorizing into a number of 
"folders". The experiments that will be discussed in the following examples are 
experiments specified as relating to "Overweight Individuals with SSRI remedy" 
contained within the folder 116, and within the sub-folder "Free Eating Experiments" 
118. 

[00471 The input panel 114 includes an experiment protocol window 120 within 
which an experiment sequence designer may identify a group of experiments to be 
performed, as well as the sequence in which these experiments are to be performed. 
For example, Figure 8 illustrates that by "dragging-and-dropping" experiments from 
the directory panel 112 into the experiment protocol window 120, the modeler has 
selected three experiments 122, 124 and 126 to be conducted in that sequence. 

[0048] Further information regarding a selected experiment within the experiment 
protocol window 120 is shown within the name field 128, the description field 130, the 
duration field 132, and a store interval field 134. 

[0049] Figure 9 shows the exemplary user interface 110, where the protocol of the 
sequence of experiments within the experiment protocol window 120 has been partially 
expanded by user selection of an expansion button 140 provided within the window 
120 for each experiment. The expanded view of each experiment provides a list of 
parameter sets 36 for the relevant experiment, as well as indicating value sets 38 for 
each parameter set 36. For example, the "Overweight due to decreased intestinal 
signaling; run for 12 months to equilibrate" experiment 144 is shown to include a total 
of two parameter sets 36, each parameter set 36 having a value set 38 specifying 
predetermined conditions. One of these parameter sets 36 is the "weight related 
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parameters (initial conditions)" parameter set 142 having a "80 kg individual with 27.5% 
body fat" value set 145 attributed thereto. 

[0050] User-selection (e.g., by double-clicking) on the listed parameter set 142 within 
the experiment protocol window 120 may, in one embodiment, generate the parameter 
set user interface 150 illustrated in Figure 10. The parameter set user interface 150 lists 
both the parameter set and the value set associated with the parameter set for the 
relevant experiment. A parameter window 152 provides a listing of parameters 
included within the relevant parameter set 142, as well as values within the value set 
144 attributed to the parameter set 142. The exemplary parameter window 152 is 
shown to include a parameter column 154, a location column 156, a type column 158, a 
baseline value column 160 and an alternative value set column 162. For each parameter, 
an entry within the parameter column 154 in the location column 156 provide an 
identifier, or designator, for the relevant parameter. 

[0051] For example, the designator "So" identifies the relevant parameter as being 
the initial value for a "state" variable for which the value is determined by a cumulative 
effect of its inputs over time. A state variable may be defined by a differential equation, 
and is attributed an initial value that is indicated in either the baseline value set column 
160 or the alternate value set column 162. 

[0052] The type column 158 provides a visual icon, or other indicia, indicating the 
type (i.e., state or function) of the object containing the parameter. 

[0053] The parameter set user interface 150 further allows an experiment designer to 
include new variables within a relative parameter set 36. This is done through, for 
example, dragging objects from the system model 10 onto the parameter window 152. 
Alternate value sets for this parameter set may be selected by clicking on the value set 
name popup menu 164 and may be created by clicking on the alternate value set popup 
menu 166. 

[0054] Figure 11 shows a diagrammatic representation of machine in the exemplary 
form of a computer system 200 within which a set of instructions, for causing the 
machine to perform any one of the methodologies discussed above, may be executed. 
In alternative embodiments, the machine may comprise a network router, a network 
switch, a network bridge, Personal Digital Assistant (PDA), a cellular telephone, a web 
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appliance or any machine capable of executing a sequence of instructions that specify 
actions to be taken by that machine. 

[0055] The computer system 200 includes a processor 202, a main memory 204 and a 
static memory 206, which communicate with each other via a bus 208. The computer 
system 200 may further include a video display unit 210 (e.g., a liquid crystal display 
(LCD) or a cathode ray tube (CRT)). The computer system 200 also includes an 
alphanumeric input device 212 (e.g., a keyboard), a cursor control device 214 (e.g., a 
mouse), a disk drive unit 216, a signal generation device 218 (e.g., a speaker) and a 
network interface device 220. 

[0056] The disk drive unit 216 includes a machine-readable medium 222 on which is 
stored a set of instructions (i.e., software) 224 embodying any one, or all, of the 
methodologies described above. The software 224 is also shown to reside, completely or 
at least partially, within the main memory 204 and/or within the processor 202. The 
software 224 may further be transmitted or received via the network interface device 
220. For the purposes of this specification, the term "machine-readable medium" shall 
be taken to include any medium that is capable of storing or encoding a sequence of 
instructions for execution by the machine and that cause the machine to perform any 
one of the methodologies of the present invention. The term "machine-readable 
medium" shall accordingly be taken to included, but not be limited to, solid-state 
memories, optical and magnetic disks, and carrier wave signals. 

[0057] Thus, a method and apparatus for designing and conducting a sequence of 
linked simulation operations have been described. Although the present invention has 
been described with reference to specific exemplary embodiments, it will be evident 
that various modifications and changes may be made to these embodiments without 
departing from the broader spirit and scope of the invention. Accordingly, the 
specification and drawings are to be regarded in an illustrative rather than a restrictive 
sense. 
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